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DETAILED ACTION 
Response to Amendment 

1 . Claims 60-77 are pending. 

2. Claims 60, 67, 73, 74, and 75 have been amended. 

3. Claims 76-77 have been added. 

4. The claim objections to claims 60, 67, and 73-75 have been withdrawn in view of 
the amendments received 12/3/2010. 

5. The 35 USC 1 01 rejection of claim 73 has been withdrawn in view of the 
amendments received 12/3/2010. 



Response to Arguments 

6. Applicant argues "However, Papineni does not disclose or suggest the operation 
of classifying a sentence in inputted text as one of a plurality of types of sentences, 
selecting a category of additional information related to the type of sentence and adding 
the additional information to the inputted text. Particularly, the system of Papineni 
responds to inputted text, it but does not add any additional information to the inputted 
text. For example, if the sentence is a question sentence "Whether.. .is questionable", 
the additional information is "Please respond to...", as described on page 10, lines 1 1 to 
23 of the present specification. In Papineni, the computer responses to the human input 
(e.g.. Please Say Yes or No) are not added to any inputted text, but rather are provided 
to the human so that the human can respond to the computer, in order to complete a 
stock transaction." (Remarks, Page 9, f 3-4) The Examiner disagrees. Column 15 of 
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Papieni teaches the above limitations. The human inputs "I want to buy one hundred 
shares" which is a sentence classified as a declaration. The computer further gathers 
information related to the fund (fund name from context) and restates it as a declaration 
back to the person and, in addition, adds a confirmation (an additional category) which 
is related to the type of sentence (declaration). Therefore, the Examiner disagrees that 
the system of Papineni does not add any additional information to the inputted text. It 
not only adds a confirmation in response to the declaration, but it also adds information 
from contextual information grabbed from input. Thus, the argument is not persuasive. 

Information Disclosure Statement 

7. The Information Disclosure Statement (IDS) submitted on 8/10/2010 is in 
compliance with the provisions of 37 CFR 1 .97. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21 (2) 
of such treaty in the English language. 

8. Claims 60, 67, and 73-74 are rejected under 35 U.S.C. 1 02(e) as being 
anticipated by Papineni et al. (US Patent #6246981) 
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As per claim 60, Papineni teaclies tine metliod comprising receiving inputted text 
with an information processing device, the inputted text including a sentence (column 1 , 
lines 22-30, . . . The input and output could be either text-oriented or speech-oriented. 
Speech-oriented systems have a speech recognition subsystem (speech-to-text 
system) and a speech synthesis subsystem (text-to-speech system)... column 15, lines 
5-67 further teach input sentences.); 

analyzing the inputted sentence with an information analysis device to determine 
information to be added comprising the steps of (column 3, lines 8-19, ...A system for 
conversant interaction includes a recognizer for receiving and processing input 
information and outputting a recognized representation of the input information. A dialog 
manager is coupled to the recognizer for receiving the recognized representation of the 
input information, the dialog manager having task-oriented forms for associating user 
input information therewith, the dialog manager being capable of selecting an applicable 
form from the task-oriented forms responsive to the input information...): 

classifying the inputted sentence as one of a plurality of types of sentences, the 
plurality of types of sentences including a question and an explanation (Papineni, 
column 15, the example shows input questions and explanations, see ...how about the 
vanguard index. . . (question), and . . ./' want to buy one hundred shares. . . (explanation).); 

selecting a category of additional information related to the type of sentence, the 
category being an expression which is suitable to the type of sentence (Papineni, 
column 15, shows selection of additional information related to the type of sentence 
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through a confirmation, ...confirming purchase of one hundred Shares of vanguard 
index trust total stock market institutional shares, please say yes or no (fund name from 
context)...); and 

selecting additional information in the selected category (Papineni, column 15, 
selects additional Information by providing specific confirmations of the Index or fund, 
...confirming purchase of one hundred Shares of vanguard index trust total stock market 
institutional shares, please say yes or no (fund name from context). . . The selected 
additional information is the specific amount and fund for the category of additional 
information (confirmation).); and 

adding the additional information to the inputted text with a change processing 
device; and outputting the inputted text to which the information is added with an 
information reproducing device (Papineni, column 15, selects additional information by 
providing specific confirmations of the index or fund, ...confirming purchase of one 
hundred Shares of vanguard index trust total stock market institutional shares, please 
say yes or no (fund name from context)... The selected additional information is the 
specific amount and fund for the category of additional information (confirmation). This 
has been added to the fund name which is taken from the context taken from the 
inputted text and it output to the user for confirmation.). 

Claims 67 and 73-74 are rejected for the same reasons as claim 60 above for 
having similar limitations and scope. Papineni further provides system and computer 
readable medium type embodiments (see Papineni columns 5-6). 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

9. Claims 60-64, 66-70, 72-75 are rejected under 35 U.S.C. 1 03(a) as being 
unpatentable by Gabai et al. (US Patent #6773344 hereinafter Gabai) in view of 
Papineni et al. (US Patent #6246981) 

As per claim 60, Gabai teaches the method comprising receiving inputted text 
with an information processing device (column 43, lines 20-34, the toy can read text for 
translation or speech synthesis.); 

analyzing the inputted text with an information analysis device, the inputted text 
including a sentence to determine information to be added comprising the steps of 
(Gabai, column 43, lines 3-19, ...It is preferred, in such cases, that a toy not merely 
translate but combine its translations with other types of content that is appropriate to 
the given situation... Gabai teaches the ability to read local or ancient languages, 
column 43, lines 20-34 where the scanner is an information analysis unit. Information to 
be added is appropriate to a given situation. Column 43, lines 35-43 teaches that the 
input may be full sentences): 
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adding tine additional information to the inputted text witli a cliange processing 
device (Gabai, column 43, lines 3-19, ...It is preferred, in sucli cases, that a toy not 
merely translate but combine its translations with other types of content that is 
appropriate to the given situation... Furthermore, column 43, lines 35-50 gives 
examples, one of which is that the user inputs a menu and then toy subsequently 
explains the cultural significance of the dishes. Figs .14 and 70 show that the output can 
be processed an generated from the internal toy process or an external computer/server 
depending on the complexity of the input/operation.); 

outputting the inputted text to which the information is added with an information 
reproducing device (Gabai, column 53, lines 26-36, ...Their response includes, but is 
not limited to sound (including voice)... Fig. 66, 8085). 

Gabai fails to specifically teach classifying the inputted sentence as one of a 
plurality of types of sentences, the plurality of types of sentences including a question 
and an explanation; selecting a category of additional information related to the type of 
sentence, the category being an expression which is suitable to the type of sentence; 
and selecting additional information in the selected category. 

However, Papineni teaches classifying the inputted sentence as one of a plurality 
of types of sentences, the plurality of types of sentences including a question and an 
explanation (Papineni, column 15, the example shows input questions and 
explanations, see ...how about the vanguard index... (question), and .../ want to buy 
one hundred shares... (explanation).); 
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selecting a category of additional information related to the type of sentence, the 
category being an expression which is suitable to the type of sentence (Papineni, 
column 15, shows selection of additional information related to the type of sentence 
through a confirmation, ...confirming purchase of one hundred Shares of vanguard 
index trust total stocf< market institutional shares, please say yes or no (fund name from 
context)...)] and 

selecting additional information in the selected category (Papineni selects 
additional information by providing specific confirmations of the index or fund, 
...confirming purchase of one hundred Shares of vanguard index trust total stock market 
institutional shares, please say yes or no (fund name from context)... The selected 
additional information is the specific amount and fund for the category of additional 
information (confirmation).). 

Gabai and Papineni are analogous art because both deal with dialog interaction 
between a human and machine. Therefore, It would have been obvious to someone of 
ordinary skill in the art at the time of the invention to apply the 
confirmations/clarifications of Papineni with the base process of dialog interaction in 
Gabai because the result would have been predictable in providing a machine/user 
dialog interaction where the machine and user have a mutual understanding of the 
current dialog state. Therefore, it would have been obvious to someone of ordinary skill 
in the art at the time of the invention to combine Papineni with Gabai. 
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As per claim 61 , claim 60 is incorporated and Gabai teaches wherein the inputted 
text is translation text that is translated from a first language to a second language with 
an automatic interpretation device (Gabai, column 43, lines 3-19, Figs. 58 A-B teach 
that the toy interprets the scanned information in a language not native to the user for 
the user's understanding.). 

As per claim 62, claim 60 is incorporated and Gabai teaches wherein a voice 
synthesis device converts the inputted text to which the information is added to a voice 
signal and outputs the voice signal (Gabai, column 20, lines 14-36, ...transfer 
information to the user through sound (possibly using text-to-speech technology). ..). 

As per claim 63, claim 60 is incorporated and Gabai teaches wherein amount of 
information to be added is determined on the basis of an analysis result (Gabai, column 
43, lines 44-50, . . . translating an ancient inscription a toy offers its user a historical 
commentary on the period and the occasion on which it was written and the subjects it 
concerns..., There is inherently a determined amount of available additional information 
because the database stores available additional information in the database that is 
retrieved based upon the analysis.). 

As per claim 64, claim 60 is incorporated and Gabai teaches where the 
information is prestored corresponding to a keyword (Gabai, column 46, lines 40-67, the 



Application/Control Number: 10/582,360 Page 10 

Art Unit: 2626 

toy listens for keywords in its analysis to understand the input and produce the 
appropriate response. Also, example II (columns 45-46) shows that the information is 
related to the input keywords.). 

As per claim 66, claim 62 is incorporated and Gabai teaches wherein the 
information is information for prompting a target (Gabai, columns 45-46, Example II, 
teaches that information is added for prompting a target using voice, column 46, lines 1- 
5). 

As per claim 67, Gabai teaches an information processing device for receiving 
inputted text, having an information changing unit for analyzing the inputted text to 
determine information to be added comprising the steps of (Gabai, column 43, lines 20- 
34, ...special scanner... Further, Gabai, column 43, lines 3-19, ...It is preferred, in such 
cases, that a toy not merely translate but combine its translations with other types of 
content that is appropriate to the given situation... Furthermore, column 43, lines 35-50 
gives examples, one of which is that the user inputs a menu and then toy subsequently 
explains the cultural significance of the dishes.): 

adding the additional information to the inputted text with a change processing 
unit (Gabai, column 43, lines 3-1 9, ...It is preferred, in such cases, that a toy not merely 
translate but combine its translations with other types of content that is appropriate to 
the given situation... Furthermore, column 43, lines 35-50 gives examples, one of which 
is that the user inputs a menu and then toy subsequently explains the cultural 
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significance of the dishes. Figs .14 and 70 show that the output can be processed an 
generated from the internal toy process or an external computer/server depending on 
the complexity of the input/operation.); 

and an information reproducing device for converting and output from the 

information changing unit to voice (Gabai, column 53, lines 26-36, ...Their response 
includes, but is not limited to sound (including voice)...). 

Gabai fails to specifically teach classifying the inputted text as one of a plurality 
of types of sentences, the plurality of types of sentence including a question and an 
explanation; selecting a category of additional information related to the type of 
sentence, the category being an expression which is suitable to the type of sentence. 

However, Papineni teaches classifying the inputted text as one of a plurality of 
types of sentences, the plurality of types of sentence including a question and an 
explanation (Papineni, column 15, the example shows input questions and 
explanations, see ...how about the vanguard index... (question), and .../ want to buy 
one hundred shares... (explanation).); 

selecting a category of additional information related to the type of sentence, the 
category being an expression which is suitable to the type of sentence (Papineni, 
column 15, shows selection of additional information related to the type of sentence 
through a confirmation, ...confirming purchase of one hundred Shares of vanguard 
index trust total stock market institutional shares, please say yes or no (fund name from 
context)...); and 
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selecting additional information in the selected category (Papineni selects 
additional information by providing specific confirmations of the index or fund, 
...confirming purchase of one hundred Shares of vanguard index trust total stock market 
institutional shares, please say yes or no (fund name from context). . . The selected 
additional information is the specific amount and fund for the category of additional 
information (confirmation).). 

Gabai and Papineni are analogous art because both deal with dialog interaction 
between a human and machine. Therefore, it would have been obvious to someone of 
ordinary skill in the art at the time of the invention to apply the 
confirmations/clarifications of Papineni with the base process of dialog interaction in 
Gabai because the result would have been predictable in providing a machine/user 
dialog interaction where the machine and user have a mutual understanding of the 
current dialog state. Therefore, it would have been obvious to someone of ordinary skill 
in the art at the time of the invention to combine Papineni with Gabai. 

Claims 68, 69 are rejected for the same reasons as claims 61 , 63. 

As per claim 70, claim 67 is incorporated and Gabai teaches wherein the 
information changing unit comprises a memory device for storing the information 
corresponding to a keyword, extracts the keyword from the inputted text and selects the 
information stored into the memory device on the basis of the extracted keyword 
(Gabai, column 46, lines 40-67, the toy listens for keywords in its analysis to understand 
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the input and produce the appropriate response. Also, example II (columns 45-46) 
shows that the information is related to the input keywords.). 

Claim 72 is rejected for the same reasons as claims 66. 

Claims 73-74 are rejected for similar reasons to claims 60 and 67. Claim 73 is 
the computer readable medium claim for the method of claim 60. The apparatus in claim 
67 has been shown to be a computer based apparatus which inherently has to be 

programmed and executed from a computer-readable medium. Claims 74-75 are the 
terminal and server claims for the method and apparatus of claims 60 and 67 (See 
Papineni, column 5-6). 

As per claim 75, Gabai teaches the server comprising a communication device 
for communicating with a terminal (Gabai, abstract, teaches that the toy can use cellular 
technology which is well known in the art to be able to independently process input as 
well as process the input through a server.); an information processing device 

for translating text received through the communication device from first language to 
second language (column 43, lines 20-34, the toy can read text for translation or speech 
synthesis. Gabai, column 43, lines 3-19, Figs. 58 A-B teach that the toy interprets the 
scanned information in a language not native to the user for the user's understanding.); 

an information changing unit for analyzing the text translated to the second 
language, determining information to be added on the basis of the analysis result 
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comprising tine steps of (Gabai, column 43, lines 3-19, ...It is preferred, in sucli cases, 
that a toy not merely translate but combine its translations with other types of content 
that is appropriate to the given situation... Gabai teaches the ability to read local or 
ancient languages, column 43, lines 20-34 where the scanner is an information analysis 
unit. Information to be added is appropriate to a given situation.); 

adding the information to the text translated to the second language (Gabai, 
column 43, lines 3-1 9, ...It is preferred, in such cases, that a toy not merely translate but 
combine its translations with other types of content that is appropriate to the given 
situation... furthermore, column 43, lines 35-50 gives examples, one of which is that the 
user inputs a menu and then toy subsequently explains the cultural significance of the 
dishes. Figs .14 and 70 show that the output can be processed an generated from the 
internal toy process or an external computer/server depending on the complexity of the 
input/operation.); 

transmitting an output from information changing unit through the communication 
device (Gabai, column 53, lines 26-36, ...Their response includes, but is not limited to 
sound (including voice)... Fig. 66, 8085). 

Gabai fails to specifically teach classifying the inputted text as one of a plurality 
of types of sentences, the plurality of types of sentence including a question and an 
explanation; selecting a category of additional information related to the type of 
sentence, the category being an expression which is suitable to the type of sentence; 
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and selecting additional information in the selected category and adding the information 
to the text. 

However, Papineni teaches classifying the inputted text as one of a plurality of 
types of sentences, the plurality of types of sentence including a question and an 
explanation (Papineni, column 15, the example shows input questions and 
explanations, see ...how about the vanguard index... (question), and .../ want to buy 
one hundred shares... (explanation).); 

selecting a category of additional information related to the type of sentence, the 
category being an expression which is suitable to the type of sentence (Papineni, 
column 15, shows selection of additional information related to the type of sentence 
through a confirmation, ...confirming purchase of one hundred Shares of vanguard 
index trust total stock market institutional shares, please say yes or no (fund name from 
context)...); and 

selecting additional information in the selected category and adding the 
information to the text (Papineni selects additional information by providing specific 
confirmations of the index or fund, ...confirming purchase of one hundred Shares of 
vanguard index trust total stock market institutional shares, please say yes or no (fund 
name from context)... The selected additional information is the specific amount and 
fund for the category of additional information (confirmation). This has been added to 
the fund name which is taken from the context taken from the inputted text and it output 
to the user for confirmation.). 



Application/Control Number: 1 0/582,360 Page 1 6 

Art Unit: 2626 

Gabai and Papineni are analogous art because both deal with dialog interaction 
between a human and machine. Therefore, it would have been obvious to someone of 
ordinary skill in the art at the time of the invention to apply the 
confirmations/clarifications of Papineni with the base process of dialog interaction in 
Gabai because the result would have been predictable in providing a machine/user 
dialog interaction where the machine and user have a mutual understanding of the 
current dialog state. Therefore, it would have been obvious to someone of ordinary skill 
in the art at the time of the invention to combine Papineni with Gabai. 

10. Claims 65 and 71 are rejected under 35 U.S.C. 103(a) as being unpatentable by 
Gabai et al. (US Patent #6773344 hereinafter Gabai) in view of Papineni et al. (US 
Patent #6246981 ) and further in view of Uwakubo. (US Patent #651 301 1 ). 

As per claim 65, claim 62 Is incorporated and Gabai and Papineni fail to 
specifically teach further comprising analyzing reaction time of a target for which the 
voice is output and determining the information on the basis of the analysis result with 
the information analysis unit. 

However, Uwakubo teaches further comprising analyzing reaction time of a 
target for which the voice is output (Uwakubo, columns 7-8, lines 63-67 and 1-8, ...a 
time period is clocked in some times, from a time when a reaction is presented to the 
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output unit 360 (to the user) to another time when the user starts action in response to 
the presented reaction. ..). 

and determining the information on the basis of the analysis result with the 
information analysis unit (Uwakubo, column 8, lines 21-31, ...generate reactions or 
suspends the generating of the reactions, based on instructions from the conversation 
manage unit 330... A reaction is generated based upon the reaction time of the user.). 

It would have been obvious to someone of ordinary skill in the art at the time the 
invention was made to combine Uwakubo with the Gabai and Papineni device because 
"prior devices can not follow changes of a length of a pause (timing) in a conversation" 
(Uwakubo, column 1, lines 38-42) The combination of Uwakubo with the Gabai and 
Papineni device would have been obvious to try because it improves smooth 
information transition and has a reasonable expectation of success. 

Claim 71 is rejected for the same reasons as claim 65. 

1 1 . Claims 76-77 are rejected under 35 U.S.C. 1 03(a) as being unpatentable by 
Papineni et al. (US Patent #6246981) in view of McAllister et al. (US Patent #6385584) 

As per claim 76, Papineni teaches the method comprising analyzing inputted text 
with an information analysis device to determine information to be added (column 3, 
lines 8-19, ...A system for conversant interaction includes a recognizer for receiving and 
processing input information and outputting a recognized representation of the input 
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information. A dialog manager is coupled to the recognizer for receiving the recognized 
representation of the input information, the dialog manager having task-oriented forms 
for associating user input information therewith, the dialog manager being capable of 
selecting an applicable form from the task-oriented forms responsive to the input 
information...), 

adding the additional information to the inputted text with a change processing 
device, and outputting the inputted text which the information is added with an 
information reproducing device (Papineni, column 15, selects additional information by 
providing specific confirmations of the index or fund, ...confirming purchase of one 
hundred Shares of vanguard index trust total stock market institutional shares, please 
say yes or no (fund name from context)... The selected additional information is the 
specific amount and fund for the category of additional information (confirmation). This 
has been added to the fund name which is taken from the context taken from the 
inputted text and it output to the user for confirmation.). 

Papineni fails to teach generating a random number; and selecting additional 

information that corresponds to the random numbers. 

However, McAllister teaches generating a random number (McAllister, column 4, 
lines 32-44); 

and selecting additional information that corresponds to the random numbers 
(McAllister, column 4, lines 32-44, the random numbers are scaled to the number of 
voice message variations available for a particular prompt); 
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McAllister and Papineni are analogous art because both pertain to language 
generation. Therefore, it would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the confirmation responses (as taught by 
Papineni, yes or no confirmations, column 15) with the random wording variation (as 
taught by McAllister) so that "random wording variations are included in the prompts as 
would be characteristic of a human operator." (McAllister, Column 2, lines 28-39) 

Claim 77 is rejected for the same reasons as claim 76 for having similar 
limitations. The additional limitation of a system is taught by Papineni where Papineni 
further provides system and computer readable medium type embodiments (see 
Papineni columns 5-6). 

Conclusion 

12. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Refer to PTO-892, Notice of References Cited for a listing of 
analogous art. 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 



Application/Control Number: 10/582,360 Page 20 

Art Unit: 2626 

TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to GREG A. BORSETTI whose telephone number is 
(571 )270-3885, (FAX: 571 -270-4885). The examiner can normally be reached on 
Monday - Friday (8am - 5pm Eastern Time). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, RICHEMOND DORVIL can be reached on 571-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 

Patent Application Information Retrieval (PAIR) system. Status information for 

published applications may be obtained from either Private PAIR or Public PAIR. 

Status information for unpublished applications is available through Private PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 

you have questions on access to the Private PAIR system, contact the Electronic 

Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 

USPTO Customer Service Representative or access to the automated information 

system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Greg A. Borsetti/ 
Examiner, Art Unit 2626 
Greg.Borsetti@uspto.gov 



/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



